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A 6“week summer institute was conductect to train and improve the research and 
evaluation competencies of 19 public school and college teachers and administrators. 
Instruction was individualized on the basis of pretest information since the major 
objective was to help the participants develop programs of research to be 
implemented during the following school year. Small instructional packages lasting from 
2 days to 3 weeks were presented to appropriate groups of participants. Each 
package consisted of units of instruction on research design, scientific method, 
sampling, operational definitions, test construction and analysis, analysis of commercial 
tests, interaction analysis, informal inventory techniques, rating scales, basic statistics, 
computer operation, computer programming, feedback, reproducibility, validity, and new 
developments in education. Special materials available for instructio included University 
computer facilities: programmed materials and computer assisted instruction; plus 
tapes, overhead transparencies, and sound motion pictures recently developed by the 
institute staff. A major strength of the program was the high level of interest 
displayed by the students. Posttest results recorded their improved skills, and their 
research proposals indicated that they were able to conceptualize a problem and put 
it into operational form. Publicity materials are appended. (JS) 
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THE UNIVERSITY OF CHICAGO 



CHICAGO, ILLINOIS 



REPORT ON SUMMER INSTITUTE 



ORIENTATION OF PROGRAM 



A Summer Institute on Research and Evaluation was 
conducted hy the staff of the Center for the Coopera- 
tive Study of Instruction at The University of Chicago 
between June 27 and August 5 for the purpose of train- 
ing and improving the research and evaluation competen- 
cies of the participants. These competencies were 
focused on plans intended to improve instruction in the 
schools • 

Applicants were accepted on the basis of their 
qualifications and upon the acceptance of clearly iden- 
tified research ideas. Most of the applicants were 
selected from Chicago and the suburbs. This was inten- 
tional since their proximity to the Center made it 
possible to plan a continuing relationship following the 
Institute , 

Members of the Institute staff were: John Ginther, 
Ph,D, , Associate Professor, The University of Chicago, 
Director, Center for the Cooperative Study of Instruc- 
tion, Robert Rippey, Ph,D,, Assistant Professor, The 
University of Chicago, Associate Director, Center for 
the Cooperative Study of Instruction and George Madaus, 
Ph,D,, Research Associate, The University of Chicago, 

The participants are listed on the following table. 
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The main oh^l^jctive of the program was to help the 
participants develop programs of research which would 
be implemented during the year following the conclusion 
of the Institute. At the same time, each individual 
was to be given training in recent developments in re- 
search technology. Finally, through course work, inde- 
pendent study and personal consultation with the Center 
staff, each individual was expected to pursue a course 
of study which would raise his level of research 
ability. 

The three staff members attempted to individualize 
instruction for each of the participants on the basis 
of pre-test information, and on the basis of their pro- 
posed plans for research. Participants worked on their 
projects, and small instructional packages lasting from 
two days to approximately three weeks were presented to 
appropriate groups of participants. These packages 
consisted of units of instruction on research design, 
scientific method, sampling, operational definitions, 
test construction and analysis, analysis of commercial 
tests, inter-action analysis, informal inventory tech- 
niques, rating scales, basic statistics, computer 
operation, computer programming, feedback, reproduci- 
bility, validity, and new developments in evaluation. 



DESCRIPTION OP THE PROGRAM 



Extensive pre and post evaluation of subjects was 
employed. A sample of instruments used may be found in 
Appendix A of the report. Each subject was given a 
questionnaire and a half hour interview prior to the 
opening of the Institute. During this interview, sev- 
eral informal oral tests were administered. In light 
of the questionnaire and the informal tests, a program 
was constructed for each student. A summary of student 
needs and interests suggested that units lasting from 
two days to three weeks should be offered on the follow- 
ing topics: 

1. Research Design 

2. Scientific Method 

3. Sampling 

U. Operational Definitions 
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Test Construction and Analysis 

6 . Analysis of Commercial Tests 

7* Inter-action Analysis 

8 c Informal Inventorying 

9. Rating Scales 

10 . Basic Statistics Through 1 Way ANOVA 

11. IBM 1620 Operation and Program Library 

12. Advanced Analysis of Variance and Other 
Topics 

13. FORTRAN 

1^1. Feedback 

15 . Reproducibility 

16 . New Developments in Evaluation 

IT. Validity 

18 . Writing Plans and Reports 

19. Materials Selection and Development 

The two basic criteria of success for the Insti- 
tute would be: 

1. Did the participant actually conduct a 
research project to completion during 
the year following the Institute? 

2. Did the participant continue to develop 
his abilities as a researcher? 

To accomplish the objectives, a new schedule of in- 
struction was made out each Friday afternoon at the 
conclusion of the homeroom meeting. During these 
homeroom meetings groups of approximately six partici- 
pants would meet with each of the Institute staff mem- 
bers. The resulting discussions would suggest the 
structure for the following week's program, and the se 
quence of topics to be presented. Some of the topics 
were offered only once. Others were repeated as parti 
cipants became more sophisticated and as their needs 
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'became clearer to them. 




In addition to the regular class sessions, the 
Institute provided the opportunity for nine individual 
conferences with staff members each day,, homeroom, and 
paper discussion sections. Among the papers discussed 
■were papers by Platt, Chamberlin, and Nagle on scien- 
tific method; papers by Cuba on research design; and 
papers by Cronbach, Scriven, Tyler, Stake, and Atkin 
on evaluation. 

The preparation of plans for research to be pur- 
sued during the coming year amounted to a major focus 
of the Institute. These plans are available in the 
files of the Center. 



EVALUATION OF THE PROGRAM 



OBJECTIVES 



Due to the individualized nature of the program, 
the objectives seemed suitable for the participants. 
Each participant did develop a plan for research. By 
July 1, 1967 ve will know more fully whether the plans 
were implemented. However, if quality of plans has 
predictive validity for completion of plans, the ob- 
jectives should be fulfilled in large measure. 



CONTENT 



The content seemed appropriate for the partici- 
pants. Some of the papers planned for discussion were 
too difficult during the early weeks of the Institute. 
Occasionally, as in the initial run of any educational 
venture, there was a scramble to find the right refer- 
ence or to see that it was available. More planning 
time should be allotted for these activities, but in a 
flexible program one cannot predict the entire range 
of demands which will be generated. 

Perhaps too much time was spent on statistics for 
some of the participants. A few felt that they would 
rather not work with data processing machines, but we 
think the experience will be profitable. 
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STAFF 



Two full-time and one half-time staff members 
served the group making the ratio of participants to 
staff approximately seven participants for each staff 
member. This ratio was almost too heavy due to the in- 
tensive nature of the program. Were we to hold another 
Institute we would involve consultants. This would re- 
duce the staff burden somewhat. 



TRAINEES 



Trainees were selected on the basis of the clarity 
of formulation of their goals. This was determined in 
individual interviews which were held with each of the 
Institute participants approximately two weeks before 
the opening of the Institute. Considerable pre-testing 
was done to make certain that the applicants were cap- 
able of carrying on the work of the Institute. However, 
due to the individualized nature of the instruction^^ the 
pre-testing was more helpful in planning the individ- 
ual's program than it was in screening out participants. 
Since the number of applications we received was not as 
large as we would have liked, we attempted to take as 
many of the applicants as we could. Seventeen of the 
nineteen participants were from the Chicago suburban 
area. Two of them were from the Boston area. Sixteen 
of the participants were commuters. 



ORGANIZATION 



Participants were required to be in attendance 
from 9:00 until U:00 each day for the six weeks of the 
Summer Institute. This requirement generated no com- 
plaints. The participants could vary their routine 
daily by electing to work or not in the Statistics 
Laboratory or the Curriculum Center. They could also 
elect to have an individual conference or not. Three 
classrooms were available for use for instruction and 
small group meetings. In addition, the Educational 
Statistics Laboratory at the University was used regu- 
larly by the Institute personnel one hour each day, and 
was available and used at other times during the day at 
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the convenience of the participants. Housing was no 
problem for the three non-commuters. One participant 
lived at International House and two participants were 
able to rent houses near the University. 



BUDGET 



The dependency allowance was considerably more 
than we needed, since most of the participants were lo- 
cal. Since participants with dependents were not en- 
titled to this allowance, it seems that a better pro- 
vision should be made for travel. Some of the partici- 
pants traveled seventy m'* les per day to come to the 
Institute, and allowing only a single round trip for 
them, and then not allowing a dependency allowance 
seemed a little harsh. 

For this type of program, it also seems that it 
should be possible to budget tuition costs. 



MAJOR STRENGTHS 



One major strength of the program was the high 
level of interest displayed by the students. After 
going through our intensive program evaluation, only 
those students came to the Institute who definitely 
were interested in doing research. The capability and 
experience of the staff in working with the kind of 
participants who attended the Institute was also a 
unique feature of the program. Since the Center has 
had several years experience in working with classroom 
teachers on research projects and has conducted regular 
seminars with these people, we were neither naive with 
respect to the difficulties which we might encounter, 
nor did we have sterotypes of teacher-behavior which 
would have caused us to underestimate the real potential 
of the delightful people with whom we were to work. 

The extensive computation facilities of the Univer- 
sity made it possible to introduce the participants to 
a rather sophisticated array of statistical techniques 
and research designs. For those who wanted to learn 
computer programming, and there were seven of the par- 
ticipants who became programmers during the Institute, 
programmed or self-instructional materials were used as 
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was cooi^Titer assisted instruction. 

The faculty had a wide range of competencies and 
- interests, and the availability of recent research find- 
ings by the faculty helped to stimulate the interest of 
the participants in research in general, and in speci- 
fic researchable questions about instruction. 

New materials of instruction were developed espe- 
cially for the Institute. In addition, tapes, overhead 
transparencies, and sound motion pictures developed in 
connection with recent research efforts of the Insti- 
tute staff were used as part of the instructional pro- 
gram. 

We thought the wide range of constant choices 
would be appealing to the participants and would prove 
pe dagogically sound. The consistently high esprit de 
corps tended to support our beliefs. 



MAJOR DIFFICULTIES 



The major difficulty of the Institute was related 
to the late date at which we were permitted to annoiince 
the awarding of the grant. This made it extremely dif- 
ficult to get the number and quality of participants 
we would have preferred. 

m 

Because of our inability to make commitmerts even 
during the first week of June, we felt obliged to dis- 
courage inquiries which arrived from distant parts of 
the country. Further, most able school personnel make 
decisions about summer opportunities by April and we 
felt very fortunate in attracting as many strong can- 
didates as we did in June. 

A second major difficulty was the discontent 
stirred by the revision of the provision for dependency 
allowance. In a major metropolitan area we are bound 
to draw heavily from persons within commuting distance. 
The dependency allowance was unavailable to commuters. 
Further, they received reimbursement for only one 
round trip to the campus although they traveled 29 
times . 
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OVERALL EVALUATION OP THE PROGRAM 



Our overall evaluation of the program is quite fa- 
vorable. Pour of the participants in the Institute made 
major career changes and committed themselves to gradu- 
ate study in educational research, as a result of our 
Institute. We attribute uhis change to the Institute 
because this is what the participants told us was re- 
sponsible for their decisions. As one of the partici- 
pants stated in a letter, "This is just a note to thank 
you for the interest in educational research you invoked 
in me this summer. But how can I thank you for a Summer 
Institute that has changed my entire life?" Th^s letter 
was received from a participant, a high school English 
teacher of great capability, who late in the summer re- 
signed from his high school teaching position and ob- 
tained a fellowship to pursue doctoral work in educa- 
tional research. In addition to the four members of the 
Institute who made major career changes and who are en- 
tering doctoral programs in educational research, sev- 
eral of the participants in the Institute have taken new 
positions, either in their own districts or in other 
school districts; positions which have given them addi- 
tional responsibilities for research. One of the parti- 
cipants, for example, moved from a teaching position in 
social science, in a Chicago Junior College, to a posi- 
tion as coordinator of research under Title I in a large 
curriculum cooperative involving thirty- five school dis- 
tricts, just south of Chicago. 

Each member of the Institute produced an acceptable 
plan for research. We will not know whether each of 
these plans was pursued in detail until the end of the 
next year. However, we plan to stay in contact with our 
participants . 

Pre-testing and post-testing of the students indi- 
cated several things. First, all of the participants 
showed an increase in their reading comprehension of 
Kerlinger*s book. Foundations of Behavioral Research. 
Each participant shoved substantial improvement in his 
understanding of basic statistical concepts on the basis 
of an oral test given before and after the Institute. A 
considerable increase in sophistication, both in writing 
plans for research and in discussing them in small group 
discussions, was observed by the staff. 

The research proposals themselves indicated that 
the participants were able to conceptualize a problem 
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and put it into an operational form. These papers which 
they produced as a key assignment in the Institute are 
on file at the Center for the Cooperative Study of In- 
struction , 

During the third week of the Institute we were 
favored by a visit from Richard Dershimer, Executive 
Director of the American Educational Research Associ- 
ation. Mr. Dershimer attended some of the Institute 
sessions and met with a group of the participants. His 
comments to us later were quite favorable and he seemed 
surprised that a group of essentially instructional per- 
sonnel were as sophisticated as they were in thinking 
about research. 

Content tests were administered during the Insti- 
tute on several occasions. These satisfied us that we 
were achieving some of the goals sampled by the test 
items. In addition an inventory of topics was given be- 
fore and after the Institute. A copy of this inventory 
is given in Appendix A. It indicated that participants 
considered that they had made gains in their understand- 
ing of the following concepts: A complete analysis of 

their responses may be found in the files of the Center. 
The item responses on the inventory ranged from a low 
of one to a high of five. 



PRE AND POST INSTITUTE QUESTIONNAIRE 
RESPONSE SUMMARY 





Concept 


Mean Pre 


Mean Post 


1. 


Randomization 


2.7 


3.8 


2. 


Chi Square 


2.5 


3.7 


3. 


Analysis of Variance 


2A 


3.5 

• 


U. 


Analysis of Covariance 


2.1 


3.1 


5. 


Multivariate Analysis 


1.9 


2.5 


6. 


Item Analysis 


2.9 


3.h 


7. 


Reliability 


3.3 


3.7 


8. 


Validity 


3.3 


3.8 
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Concept 



Mean Pre Mean Post 



9. Construct Validity 


2.2 


3.5 


10. Bloom Taxonomy 


2.2 


3.7 


11. FORTRAN 


1.9 


2.6 


12. Operational Definitions 


2.5 


3.9 


13. Criterion Reference 


l.h 


2.9 


lU. Informal Inventory 


1.8 


2.5 


13* Multiple Regression 


2.0 


2.8 


l 6 . Point Biserial Correla- 
tion 


1.6 


2 .U 


IT. Tyler Rationale 


1.8 


2.6 


l 8 . Crossed Design 


1.3 


2.7 


19. Nested Design 


1.2 


2.3 


20. Quasi Experimental 
Design 


1.2 


2.8 


21. Time Series 


1.5 


2.3 


22. KR 20 


1.5 


2.3 


23. Item Banks 


2.0 


3.U 


2 U. Independent Variable 


2.9 


U.O 


25. Hypothesis 


3.1 


U.l 


26 . Intervening Variable 


2.2 


3.5 


27 . Stereopath 


1.5 


2.5 


28 . Correlated Groups 


2.U 


3.0 


29 . Standard Error of Esti- 
mate 


2.6 


3.U 


30. Within Cells Variance 


2.0 


3.5 


31. Behavioral Objective 


2.6 


U.l 




13 







Concept 



Mean Pre Mean Post 



32. Affective Domain 



2.5 



3.6 



33. Predictive Validity 



2.7 



3.U 



3^. Correlational Study 



2.8 



3.5 



35. Control Group 



3.2 



3.8 



36 . Seq.uential Item Test 2.3 



3.0 



37. Formative Evaluation 



1.9 



3.0 



38 . Summative Evaluation 1.9 



3.1 



Most of the items which did not show significant 
increases were not taught, or were meaningless terms 
used as a check on the response validity. The Corsi 
Curtin Test and the term TERMIT received post scores 
of 1.11 and 1.17 respectively which speaks well of 
the honesty of the participants. 



RECOMMENDATIONS RELATED TO THE USOE ADMINISTRATION OF 
THE EDUCATIONAL RESEARCH TRAINING PROGRAM 



In general we are favorably impressed hy the goals 
and procedures established for the Educational Research 
Training Program. One serious difficulty was the fact 
that we simply did not have sufficient time to sample 
and select from among the persons we know about. The 
late date at which we received authorization to an- 
nounce receipt of the grant was a matter of extreme 
concern for us. 



PUBLICITY 



The proposed program was described in the March 
1965 meeting of the Center’s Seminar for Research 



PROGRAM REPORTS 



lU 



Directors. Announcements were also mailed to each of 
the schools on our mailing list. See Appendix A. This 
means direct mail contact with approximately 100 persons 
in the Chicago suburban area. In addition, personal 
contacts were made with persons whom we felt might be 
interested in participating in the program. A severe 
restriction which we encountered in connection with our 
publicity was the fact that we were instructed by the 
Office of Education not to announce that we had received 
the grant. Therefore any mention of stipends or other 
support could not be given to the applicants until less 
than one month before the opening of the Institute. Be- 
cause of this restriction it was very difficult to en- 
courage and obtain applications from those persons who 
might have been best qualified for this Institute. 



APPLICATION SUMMARY 



a. Approximate number of inquiries from 
prospective trainees (letter or con- 
versation) 

b. Number of completed applications re- 
ceived 



c. Number of first rank applications 
(applicants who are well-qualified 
whether or not they were offered 
admission) 

d. How many applicants were offered ad- 
mission 



TRAINEE SUMMARY 



a. Number of trainees initially accep- 
ted in program 20 

Number of trainees enrolled at the 
beginning of program 19 

Number of trainees who completed 
program 19 



UO 



26 



10 



20 




15 



b. Categorization of trainees 

(1) Number of trainees who prin- 

cipally are elementary or sec- 
ondary public school teachers 12 _ 

(2) Number of trainees who are 

principally local i>ublic school 
administrators or ti\pervisors ^ 

(3) Number of trainef.t^ from state 

education groups 0, 

(4) Number of trainees from col- 
leges or universities, junior 
colleges, research bureaus, 

etc. Junior Colleges 3 

Universities 2 



PROGRAM DIRECTOR'S ATTENDANCE 



a. What was the number of instructional 

days for the program? -29 

b. What was the percent of days the 

director was present? 100 



FINANCIAL SUMMARY 



Trainee 


Support 


(1) 


Stipends 


(2) 


Dependency 

Allowance 


(3) 


Travel 


Direct 


Costs 


(1) 


Personnel 



Expended 

Budgeted or Committed 



$11,250.00 

5 , 670.00 

500.00 

5,174.00 



$ 8,550.00 

540.00 

437.56 



5,879.44 









Expended 

Budgeted or Committed 



(2) 


Supplies 


200.00 


U91.53 


(3) 


Equipment 


- 


- 


i^) 


Travel 


- 


- 


(5) 


Other 


300.00 


UliO.30 



c. Indirect Costs 

TOTAL 



1,8U8.00 

$2U,9li2.00 



1,2U8.76 

$17,587.59 
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APPENDIX A 



ANNOUNCEMENT OF INSTITUTE, APPLICATION FORM, AND 
PRELIMINARY EVALUATION FORM 



SUMMER RESEARCH INSTITUTE 
SPONSORED BY 

CENTER FOR THE COOPERATIVE STUDY OF INSTRUCTION 
THE UNIVERSITY OF CHICAGO 



The Center for the Cooperative Study of Instruction 
is pleased to announce that it has received a grant 
which will enable it to conduct a Summer Institute in 
Research and Evaluation, The Summer Institute will last 
for six weeks, from June 27 to August 3 9 1966 and will 
be given in lieu of the two workshops previously an- 
nounced by the Center, Projects of particular interest 
to schools from which the applicants will be drawn will 
form the core of emphasis of the program, A secondary 
focus of the Institute will be the study of numerous 
evaluation technologies and the design of experiments. 
The following topics are planned for coverage during the 
Institute : 

1, Specifying objectives 

2, Technologies of evaluation 

3, Reliability and validity 

U, Interpretation of data 

5. Hypotheses and operational definitions 

6, Replicability 

7* Experimental design 

8, Controls and procedural validity checks 

9* Analysis of findings 
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STIPENDS 



AppXicants S8l@ct/3d for uhls XuSui'bU'&6 wlXX roccive 
a stipend of $75.00 per week for the six weeks of the 
Institute as well as a dependency allowance of $15.00 a 
week for each dependent. In addition to this all tui- 
tion expenses for the workshop will be supported by the 
grant. Participants will be able to earn credit for 
two courses eq.ulvalent to 6 2/3 semester hours of cre- 
dit for their participation. 



ACTIVITIES OF THE SUMMER INSTITUTE 



Applicants will be expected to come to the Insti- 
tute with a proposal for research or evaluation clearly 
identified. A brief description of the proposal of the 
^PP^^cant will constitute a portion of the application 
and applicants will be selected on the basis of several 
criteria, one of which will be the clarity of purpose 
of the applicant. The workshop hopes to accomplish two 
basic objectives. The primary objective of the Summer 
Institute is to assist the applicant in designing and 
implementing the investigation which he has formulated. 
The workshop also will develop in the applicant certain 
basic competencies in the area of evaluation, research 
design and data analysis, which will make it possible 
for him to pursue these activities independently in his 
own school. Institute meetings will be conducted from 
9:00 to h:00 each weekday. In the morning from 9:00 to 
11:00 participants will receive formal instruction and 
work on projects of common Interest. Students may also 
elect to do independent work in the library, the cur- 
riculum laboratory or the computer laboratory during 
this time. In addition participation in one optional 
class in evaluation or statistics can be worked out on 
an individual basis where this is desired. From 11:00 
until 12:00 each weekday, individual .conferences will 
be arranged with staff members of the Center. Prom 
1:00 to h:00 in the afternoon the formal instruction, 
group work, and project planning will be continued. No 
formal activities have been scheduled for evenings or 
Weekends during this Institute, although the full range 
of cultural activities of the University will be open 
to participants. Although most participants are expec- 
ted to be commuters, housing facilities may be arranged 
for in the event that participants wish to live on cam- 
pus during the Institute. 
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The Institute will be structured to maximize indi- 
vidual work. This means that the instruction and the 
type of work done by the individual will depend to some 
extent on his background. Thus the workshop can accept 
persons ranging from minimal backgrounds in research 
and evaluation to those of average sophistication in 
this area. In the event that you have any further 
^.uestions about this Summer Institute, you may write or 
phone either Mr, John Ginther or Mr, Bobert Rippey, 
Center for the Cooperative Study of Instruction, The 
University of Chicago, 5835 Kimbark, Chicago, Illinois 
60637 . The telephone number of the Center is MI 3-0800, 
Extension 3812 or 3839. 



INSTRUCTIONS FOR APPLICATION 



Applicants should send their applications to 
Mr. John Ginther, Center for the Cooperative Study of 
Instruction, Judd Hall, ^5835 S. Kimbark, Chicago, Illi- 
nois before May 1, 1966, Applications received before 
that date will be acted upon as soon as possible, and 
it is expected that announcement of stipends will be 
made before May 15. A transcript of credits from the 
institution from which the applicant has received his 
highest degree would be desirable, though not recjuired. 
It is expected that most applicants will be either pri- 
mary or secondary school administrators , research direc- 
tors, curriculum coordinators or teachers who have a 
strong Interest in research and who have particular 
questions which they intend to explore during the coming 
year. It is possible that a few applicants who are col- 
lege teachers may be accepted for this program on the 
basis of interesting research proposals. 



♦This document was prepared in anticipation of the grant. 
However, it was not circulated until authorization was 
received from the Office of Education. This was later 
than the date of May 1 in the text. 
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APPLICATION FOR PARTICIPATION IN 



SUMMER RESEARCH INSTITUTE 
CENTER FOR THE COOPERATIVE STUDY OF INSTRUCTION 
The University of Chicago 
June 27 - August 5 » 1966 



Name 

Home Address 

Current School Address 



Home Phone 




School Phone 


Married 


Yes 


No 



What is the number of dependents vhich you claim on your 
income tax return? This should not include yourself. 



Will you commute or live on campus during the Institute? 
(circle one ) 

Do you need additional information about university 
housing? Yes No 

Will you be teaching at the school listed above during 
the year 1966-67? Yes No 

If the answer to the above question is No, please give 
your school address and phone number for the year 1966- 
67. 

Address 

Phone 

Please describe your assignment for the coming year. 







Please list ‘below any courses 
or research design which yovi 



in evaluation, statistics 
have taken previously. 



« 



Name of course 



Year taken 



Please list your degrees below. 



Degree Area of specialization Institution 



Year 



t- o 

F ERIC 
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MM 



NAME 



The following is a list of topics which might he 
included in the Center for the Cooperative Study of In- 
struct ion *s Summer programs in research and evaluation. 
Next to each topic, please place the number which cor- 
responds most closely to your feeling about this topic. 

1. Never heard of it. 

2. Heard of it but that is about all. 

3. Studied it hut would like to know more 
about it . 

4. Have used it and feel familiar with it. 

5. Am so experienced with it that further 
discussion seems a waste of time. 



1. Randomization 

2. Chi-Square 

3. Analysis of Variance 

4. Analysis of Covariance 

5. Multivariate Analysis 

6. The Varimax Criterion 

7. Item Analysis 

8. Reliability 

9. Validity 

10. Differential Diagnosis 

11. Guttman Scale 

12. Construct Validity 

13. Bloom Taxonomy 

14. Simulation 

15. Item Sampling 

16 . FORTRAN 

IT. COMIT 

18. Programmed Instruction 

19. Latency 

20. Kolmogoroff-Smirnoff Test 

21. Corsi-Curtin Test 

22. Operational Definitions 

23. Criterion Referenced Examination 

24. Informal Inventory Technique 

25. Multiple Regression 

26. Beta Weight 

27. Point Bi-serial Correlation 

28. Tyler Rationale 
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29. Crossed Design 

30. Nested Design 

31. Quasi Experimental Design^ 

32. Time Series Analysis 

33. K.R. 20 

3^. Spearman Brown Formula 

35. Correction for Attenuation 

36 . Item Banks 

37. Extinction 

38 . Independent Variable 

39 . Hypothesis 

UO. Intervening Variable 

kl. Orthogonal Contrast 

U2. Contrast of Effects 

1*3. TERMIT 

Uk , Leveler 

U 5 . Stereopath 

U6. Dogmatism 

U 7 . Correlated Groups 

U 8 . Standard Error of Estimate 
1*9. Within Cells Variance 

50 . Behavioral Objective 

51 . Affective Domain 

52 . Predictive Validity 

53. Correlational Study 

5 I*. Control Group 

55 . Sequential Item Test 

56 . Formative Evaluation 

57. Summative Evaluation 



NAME 



1, If you would like the summer program to take up any 
of the above topics, please draw a circle around it. 
If you would like the summer program to spend some 
time on any topic not on the above list, please des- 
cribe or list the topic in the space below 



2. What educational problem are you interested in solv 
ing or evaluating as a result of your summer work? 



3, With respect to the above question, what variables 
are you especially interested in measuring? Do you 
have any ideas for measuring these variables? 

Please list any instruments or techniques which you 
have in mind. 



U, Please ask the superintendent of your district or 
your director of instruction to submit a letter of 
recommendation. In this letter, he should include 
a statement of his knowledge of your intended study, 
as well as a statement of his support. 
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